ISAAC ASIMOV
ROBOT DREAMS
MASTERWORKS OF SCIENCE FICTION AND FANTASY
ILLUSTRATED BY RALPH MCQUARRIE
A BYRON PREISS VISUAL PUBLICATIONS, INC. BOOK
ACE BOOKS, NEW YORK
Contents
The Machine That Won the War 107
Science fiction has certain satisfactions peculiar to itself. It is possible, in trying to portray future technology, to hit close to home. If you live long enough after writing a particular story, you may actually have the pleasure of finding your predictions reasonably accurate and yourself hailed as a sort of minor prophet.
This has happened to me in connection with my robot stories, of which “Light Verse” (included here) is an example.
I began writing robot stories in 1939, when I was nineteen years old, and, from the first, I visualized them as machines, carefully built by engineers, with inherent safeguards, which I called “The Three Laws of Robotics.” (In doing so, I was the very first to use the word “robotics” in print, this taking place in the March, 1942 issue of Astounding Science Fiction.)
As it happened, robots of any kind were not really practical until the mid-1970s when the microchip came into use. Only that made it possible to produce computers that were small enough and cheap enough, while possessing the potentiality for sufficient capacity and versatility, to control a robot at nonprohibitive expense.
We now have machines, called robots, that are computer-controlled and are in industrial use. They increasingly perform simple and repetitious work on the assembly lines—welding, drilling, polishing and so on—and they are of increasing importance to the economy. Robots are now a recognized field of study and the precise word that I invented is used for it—robotics.
To be sure, we are only at the very beginning of the robotic revolution. The robots now in use are little more than computerized levers and are very far from having the complexity necessary for the Three Laws to be built into them. Nor are they anything close to human in shape, so they are not yet the “mechanical men” that I have pictured in my. stories, and that have appeared on the screen innumerable times.
Nevertheless, the direction of movement is clear. The primitive robots that have come into use are not the Frankenstein-monsters of equally primitive science fiction. They do not lust for human life (although accidents involving robots can result in human death, just as accidents with automobiles or electrical machinery can). They are, rather, carefully designed devices intended to relieve human beings of arduous, repetitive, dangerous, nonrewarding duties so that, in intent and in philosophy, they represent the first steps toward my story—robots.
The steps that are yet to come are expected to proceed further in the direction I have marked out. A number of different firms are working on “home robots” that will have a vaguely human appearance and will fulfill some of the duties that once devolved on servants.
The result of all this is that I am held in considerable regard by those working in the field of robotics. In 1985, a fat encyclopedic volume entitled Handbook of Industrial Robotics (edited by Shimon Y. Nof and published by John Wiley) appeared, and, on request of the editor, I supplied it with an introduction.
Of course, in order to appreciate the accuracy of my predictions, I had to be fortunate enough to be a survivor. My first robots appeared in 1939, as I say, and I had to live for over forty more years in order to discover I was a prophet. Because I had begun at a very early age, and because I was fortunate, I managed to do this and words cannot tell you how grateful I am for that.
Actually, I carried on my predictions of the future of robotics to the very end, to the ultimate moment, in my story “The Last Question,” published in 1957. I have a sneaking suspicion that, if the human race survives, we may continue to progress in that direction in some ways anyway. Still, survival is limited at the best, and I have no chance of seeing very much more of the future course of technology. I will have to content myself with having future generations witness and (I hope) applaud what triumphs of this sort I may gain. I, myself, won’t,
Nor are robots the only area in which my crystal ball was clear. In my story “The Martian Way,” published in 1952, I described a space walk quite accurately, although an actual feat of this sort didn’t take place till fifteen years afterward. Foreseeing space walks was not a very daring piece of prescience, I admit, for, given spaceships, such things would be inevitable. However, I also described the psychological effects and thought of one that was rather unusual—particularly for me.
I am, you see, a pronounced acrophobe with an absolute terror of heights and know perfectly well that I will never voluntarily go on a spaceship. If, however, I were somehow forced on one, I know, too, that I would never dare leave it for a space walk. Nevertheless, I put personal fear to one side and imagined the space walk to produce euphoria. I had my space travelers quarrel over whose turn it was to get out into space and drift in quiet peace among the stars. And when space walks became fact, such euphoria was felt.
In my story, “The Feeling of Power,” published in 1957, I made use of pocket computers, about a decade before the real thing came along. I even considered the possibility that such computers might seriously decrease the ability of people to do arithmetic in the old-fashioned way, and that is a real concern of educators now.
As a final example, in my story “Sally,” published in 1953, I described computerized cars that had almost reached the stage of having lives of their own. And, in the last few years, we do indeed have computerized cars that can actually talk to the driver—although their abilities in this direction are, as yet, very simple.
Yet, if there is the possibility of this satisfaction from accurate prophecy in science fiction, there is also the reverse. Science fiction offers its writers chances of embarrassment that no other form of fiction does.
After all, if we may prove accurate in our predictions, we may prove inaccurate as well, sometimes ludicrously so.
Such embarrassment becomes particularly acute when one’s stories are reprinted in a collection such as this one. When an author starts young, lives out a normal lifetime (as I seem to be doing) and has written continuously, there is likely to be included in the collection stories that were written and published thirty and forty years before and that leave ample scope for any cloudiness in the crystal ball to show up.
This doesn’t happen to me as often as it might, for I have several things going for me. In the first place, I am well acquainted with science and am not likely to be wrong in fundamentals. Secondly, I am cautious in my predictions and do not flail away madly in contravention of scientific principles.
Nevertheless, science does advance and sometimes produces completely unexpected results in a very few years, and this may leave a writer (even me) high and dry on a pinnacle of false “facts. “ The worst luck I had in this respect turned up in connection with a series of science fiction novels I wrote for youngsters between 1952 and 1958.
That series dealt with the continuing adventures of my heroes on various planets of the solar system, and in each case, I carefully described the planets in strict accordance with what was known about them at the time.
Unfortunately, it was in the course of those very years that microwave astronomy was developed and shortly after those years that rocket probes began to be sent out. The result was that our knowledge of the solar system was startlingly advanced and we learned something new and unexpected about every single planet.
For instance, in my description of Mercury in Lucky Starr and the Big Sun of Mercury, I had it facing one side to the Sun, as astronomers then thought—and that was essential to the plot. As it happens, however, we now know that Mercury turns slowly and that every portion of its surface gets sunlight part of the time. There is no “dark side.”
In my description of Venus in Lucky Starr and the Oceans of Venus, I had a planetwide ocean, which, at that time, seemed at least possible. It was essential to the plot as well. However, we now know that the surface of Venus is at a temperature far above the boiling point of water, and an ocean—or even a drop—of liquid water on its surface is totally impossible.
As for Mars, in my book David Starr: Space Ranger, I managed to get the description right in many ways. However, I didn’t take advantage of the huge extinct Martian volcanoes that were discovered about fifteen years after the book was published. What’s more, I did talk about the canals (dry ones), which were found to be nonexistent, and I introduced intelligent Martians remaining from a long-dead surface civilization, and this is really extremely unlikely.
Jupiter and its satellites appeared in Lucky Starr and the Moons of Jupiter, and while I was careful to describe all the worlds, I naturally missed some major points that were not discovered till twenty years afterward. I said nothing of the cracked world-girdling glacier of Europa and nothing of Io’s active volcanoes. I didn’t mention Jupiter’s huge magnetic field. Nor, in Lucky Starr and the Rings of Saturn, did I mention some of the interesting features of the Saturnian satellite system and rings.
The only book in the series that survived intact (scientifically speaking) was Lucky Starr and the Pirates of the Asteroids.
Fortunately, there was a way out. Honesty in the best policy and when the Lucky Starr series was reprinted in the 1970s, I insisted on inserting introductory notes explaining where the astronomical details had become outdated. At first, the publishers were a little reluctant to do so, but I explained that I could not allow the young reader to be misled, or, if he were knowledgeable, to have him think that I was not. In went the notes, and, I am glad to say, sales were not adversely affected.
None of the stories in this collection was as badly shattered as my poor Lucky Starr books were, but there are things to beware of.
In the first place, there is one place where I missed something that was (in hindsight) very obvious, and I have been kicking myself over it for the last couple of years.
In “The Martian Way,” the same story in which I triumphed with my description of the spacewalk, I had my heroes approach Saturn and actually enter the ring system. In doing so I very carefully described the rings, making use of observations from Earth’s surface to do so.
Now, from Earth’s surface, some 800 million miles from Saturn, we see the rings as solid and unbroken except for the black line of the Cassini division that seems to separate them into two rings. The portion of the rings closest to Saturn is considerably dimmer than the rest of the ring system, and that portion is usually considered a third ring (the so-called “crepe ring.”) And that was how I described the rings as seen by my space-travelers in the story.
Yet it stands to reason (at least, now it stands to reason) that if we could see the ring system from a nearer distance, we would see greater detail. We would see divisions—places where fewer particles were in orbit so that we would see dimmer lines separating brighter lines—divisions that would simply not be seen at great distances. Earth’s surface telescopes would just blur them out and record only the thickest of the dim lines—the Cassini division.
The closer we would get, the more numerous and the thinner the bright lines would get as visibility became clearer and clearer, until, when we were as close as we could get and still see all the rings, the rings would look like a grooved record—which is what they do look like.
Suppose I had figured this out in 1952 and had described the rings in that fashion. Even if I had missed such things as shadowy “spokes” in the ring, and “braided” rings, things that were absolutely unpredictable, it would have been great if I had imagined the fine divisions. That was an easy deduction to make and if I had described the rings in that fashion then, as soon as those rings had been probed I would have announced that I had anticipated what they had discovered. (You think that modesty would have held me back? Don’t be an idiot!)
How great that would have been! As it is, my failure to see this marks me down as not very bright, and that is there, for all to see, in “The Martian Way.” To be sure, no astronomer saw the truth about the rings in 1952, but what of that? An astronomer is only an astronomer and his vision is naturally limited. I am a science fiction writer and more is expected of me.
Then, too, sometimes when I saw accurately, or when I saw something that might well prove to be accurate some day, then I generally placed it far too far into the future. I admit I got the robots correct, for my earliest stories indicated that they got their start in the 1980s and 1990s, which is not bad at all.
However, what of the computerized cars in “Sally” and of the pocket computers in “The Feeling of Power”? I was careful not to give the exact dates of discovery of these advances. (I may be dumb, but I’m not that dumb.) Still, there’s no doubt as we read the stories that they are discoveries of the far future—yet they’re here now and I have lived to see them, and be embarrassed over my lack of confidence in the human mind and human ingenuity.
“Breeds There a Man...?” deals, in part, with the development of an advance against the nuclear bomb. It was published in 1951 and, although I don’t date it, the impression it gives is that its events take place in the near future, perhaps just a few years after 1951.
I was clearly wrong in this, for real discussions of possible defenses didn’t come till the 1980s.
What’s more, my notion of a defense was a purely static one—the creation of a force-field shield strong enough to resist even a nuclear explosion (the story was written before the H-Bomb was invented, by the way). Now that we are considering a nuclear defense, we are talking of an active one. We are talking of the use of computerized X-ray lasers, designed to shoot down intercontinental ballistic missiles as soon as they are launched and move beyond the atmosphere. Frankly, I don’t think this will work either, but it is considerably more advanced than my own foolish speculation of the matter in 1951, thirty-five years ago.
Generally, I can do my best foreseeing once I’m given a hint (a good strong hint). In my robot stories, I postulated robots that were so huge that they were immobile and that could do nothing but think and communicate the results of those thoughts. I had one like that in my very first robot story. In later robot stories I called them “brains.” I didn’t think to call them computers.
My robots, too, had “brains” that made them work, and I never spoke of them as computers, either. I had to make them science-fictionish, of course, so I called them “positronic brains.” Positrons had been detected for the first time only four years before my first robot story had been written.
Positrons were exciting particles, bringing with them visions of “antimatter.” For that reason, I thought positronic brains was a phrase that sounded good. They would not be essentially different from electronic brains, except that positrons could be made to come into being and would then be destroyed in a millionth of a second or so by all the electrons that surround them, no matter where on Earth they were. That gave me the notion that they might be seen as responsible for the rapidity of thought. To be sure, the energy relationships—the energy required to produce positrons in quantity or the energy released when positrons are destroyed in quantity—are horrendous, so great that the notion of positronic brains is forever impossible, in all likelihood—but I ignored that.
It wasn’t until after computers were invented and the public was made aware of their existence, that computers began to exist in my stories, and even then I didn’t truly conceive of the possibility of miniaturization. Yes, I spoke of rocket computers but I visualized them as scarcely more powerful than a slide rule.
But eventually I did grasp miniaturization—naturally, after the process had started. In “The Last Question” I began with my usual computer, Multivac, as large as a city, for I could only conceive a larger computer by imagining more and more vacuum tubes heaved into it. But then, in that story, I began miniaturizing and miniaturizing far beyond what I think there is any real possibility of.
However, I suspect the readers are always ready to forgive a poor science fiction writer getting to be out-of-date. As I said, my “Lucky Starr” books were not hurt for being out-of-date. As a matter.of fact, H.G. Wells’s The War of the Worlds is still read avidly, nearly a century after it was published and despite the incredibly false picture of Mars that it represents (false in the light of the Mars we know today). The pictures of Mars given by Edgar Rice Burroughs, a generation after Wells, and by Ray Bradbury even as late as the 1950s, are also in no way comparable to the real thing, and yet that doesn’t make it impossible to read A Princess on Mars or The Martian Chronicles, either.
That is because there is more to a science fiction story than the science it contains. There is also the story and if the science it contains is bent because of later discoveries, or because the plot absolutely demands the bending, we tend to forgive and overlook.
For instance, in my story “The Billiard Ball” I have a billiard ball enter a region of space in which it instantly assumes the speed of light. This is undoubtedly impossible, but even in terms of my bending of science, there is something more impossible. The billiard ball has a finite volume. Part of it enters the region first and that part instantly assumes the speed of light and breaks away from the rest. In short, the billiard ball must be reduced to atoms, or objects even less substantial, yet in the story it retains its integrity. My
Conscience hurt me, but I just let it hurt and did what I had to do.
In “The Ugly Little Boy,” I have a version of time travel and I firmly believe that time travel is impossible. However, I ignored that because the story is only tangentially about time travel. What it is really about is love.
Again I doubt that human beings will ever become living energy vortexes, though I present them as such in “Eyes Do More Than See,” Who cares? The story is really about the beauty of material things.
I think you see what I am getting at. You may, in reading the following stories, find points in science that are inaccurate in themselves, or that are made inaccurate by subsequent advance. But if you write to tell me about it, please tell me also if you enjoyed the story anyway. You might not, of course, but I hope you will.
One more thing. My story collections are usually unillustrated and this doesn’t bother me, for I am not very visual. I am a wordman. Nevertheless, this collection is illustrated by Ralph McQuarrie and I must admit it adds immeasurably to the beauty of the book and even adds to the sense of the stories, by placing the reader into the proper visual attitude. The cover illustration, which inspired my story “Robot Dreams,” written for this collection, is beautiful and humanizes a robot in a way I have never seen before. Perhaps none of this is terribly surprising, for Ralph is one of the best and most influential of all science fiction artists, having been involved with such blockbuster movies as “Star Wars” and “The Empire Strikes Back.” In 1986 he won an Oscar for special effects for the film “Cocoon.” I am so proud to have him part of this book.
Measures on Hyper Base had been taken in a sort of rattling fury — the muscular equivalent of a hysterical shriek.
To itemize them in order of both chronology and desperation, they were:
All work on the Hyperatomic Drive through all the space volume occupied by the Stations of the Twenty-Seventh Asteroidal Grouping came to a halt.
That entire volume of space was nipped out of the System, practically speaking. No one entered without permission. No one left under any conditions.
By special government patrol ship, Drs. Susan Calvin and Peter Bogert, respectively Head Psychologist and Mathematical Director of United States Robot & Mechanical Men Corporation, were brought to Hyper Base.
Susan Calvin had never left the surface of Earth before, and had no perceptible desire to leave it this time. In an age of Atomic Power and a clearly coming Hyperatomic Drive, she remained quietly provincial. So she was dissatisfied with her trip and unconvinced of the emergency, and every line of her plain, middle-aged face showed it clearly enough during her first dinner at Hyper Base.
Nor did Dr. Bogert’s sleek paleness abandon a certain hangdog attitude. Nor did Major-general Kallner, who headed the project, even once forget to maintain a hunted expression. In short, it was a grisly episode, that meal, and the little session of three that followed began in a gray, unhappy manner.
Kallner, with his baldness glistening, and his dress uniform oddly unsuited to the general mood, began with uneasy directness.
“This is a queer story to tell, sir, and madam. I want to thank you for coming on short notice and without a reason being given. We’ll try to correct that now. We’ve lost a robot. Work has stopped and must stop until such time as we locate it. So far we have failed, and we feel we need expert help.”
Perhaps the general felt his predicament anticlimactic. He continued with a note of desperation, “I needn’t tell you the importance of our work here. More than eighty percent of last year’s appropriations for scientific research have gone to us–”
“Why, we know that,” said Bogert, agreeably. “U. S. Robots is receiving a generous rental fee for use of our robots.”
Susan Calvin injected a blunt, vinegary note, “What makes a single robot so important to the project, and why hasn’t it been located?”
The general turned his red face toward her and wet his lips quickly, “Why, in a manner of speaking we have located it.” Then, with near anguish, “Here, suppose I explain. As soon as the robot failed to report a state of emergency was declared, and all movement off Hyper Base stopped. A cargo vessel had landed the previous day and had delivered us two robots for our laboratories. It had sixty-two robots of the... uh... game type for shipment elsewhere. We are certain as to that figure. There is no question about it whatever.”
“Yes? And the connection?”
“When our missing robot failed of location anywhere — I assure you we would have found a missing blade of grass if it had been there to find — we brainstormed ourselves into counting the robots left of the cargo ship. They have sixty-three now.”
“So that the sixty-third, I take it, is the missing prodigal?” Dr. Calvin’s eyes darkened.
“Yes, but we have no way of telling which is the sixty-third.”
There was a dead silence while the electric clock chimed eleven times, and then the robopsychologist said, “Very peculiar,” and the corners of her lips moved downward.
“Peter,” she turned to her colleague with a trace of savagery, “what’s wrong here? What kind of robots are they, using at Hyper Base?”
Dr. Bogert hesitated and smiled feebly, “It’s been rather a matter of delicacy till now, Susan.”
She spoke rapidly, “Yes, till now. If there are sixty-three same-type robots, one of which is wanted and the identity of which cannot be determined, why won’t any of them do? What’s the idea of all this? Why have we been sent for?”
Bogert said in resigned fashion, “If you’ll give me a chance, Susan — Hyper Base happens to be using several robots whose brains are not impressioned with the entire First Law of Robotics.”
“Aren’t impressioned?” Calvin slumped back in her chair, “I see. How many were made?”
“A few. It was on government order and there was no way of violating the secrecy. No one was to know except the top men directly concerned. You weren’t included, Susan. It was nothing I had anything to do with.”
The general interrupted with a measure of authority. “I would like to explain that bit. I hadn’t been aware that Dr. Calvin was unacquainted with the situation. I needn’t tell you, Dr. Calvin, that there always has been strong opposition to robots on the Planet. The only defense the government has had against the Fundamentalist radicals in this matter was the fact that robots are always built with an unbreakable First Law — which makes it impossible for them to harm human beings under any circumstance.
“But we had to have robots of a different nature. So just a few of the NS-2 model, the Nestors, that is, were prepared with a modified First Law. To keep it quiet, all NS-2’s are manufactured without serial numbers; modified members are delivered here along with a group of normal robots; and, of course, all our kind are under the strictest impressionment never to tell of their modification to unauthorized personnel.” He wore an embarrassed smile; “This has all worked out against us now.”
Calvin said grimly, “Have you asked each one who it is, anyhow? Certainly, you are authorized?”
The general nodded, “All sixty-three deny having worked here — and one is lying.”
“Does the one you want show traces of wear? The others, I take it, are factory-fresh.”
“The one in question only arrived last month. It, and the two that have just arrived, were to be the last we needed. There’s no perceptible wear.” He shook his head slowly and his eyes were haunted again, “Dr. Calvin, we don’t dare let that ship leave. If the existence of non-First Law robots becomes general knowledge–” There seemed no way of avoiding understatement in the conclusion.
“Destroy all sixty-three,” said the robopsychologist coldly and flatly, “and make an end of it.”
Bogert drew back a corner of his mouth. “You mean destroy thirty thousand dollars per robot. I’m afraid U. S. Robots wouldn’t like that. We’d better make an effort first, Susan, before we destroy anything.”
“In that case,” she said, sharply, “I need facts. Exactly what advantage does Hyper Base derive from these modified robots? What factor made them desirable, general?”
Kallner ruffled his forehead and stroked it with an upward gesture of his hand. “We had trouble with our previous robots. Our men work with hard radiations a good deal, you see. It’s dangerous, of course, but reasonable precautions are taken. There have been only two accidents since we began and neither was fatal. However, it was impossible to explain that to an ordinary robot. The First Law states — I’ll quote it — ‘No robot may harm a human being, or through inaction, allow a human being to come to harm.’
“That’s primary, Dr. Calvin. When it was necessary for one of our men to expose himself for a short period to a moderate gamma field, one that would have no physiological effects, the nearest robot would dash in to drag him out. If the field were exceedingly weak, it would succeed, and work could not continue till all robots were cleared out. If the field were a trifle stronger, the robot would never reach the technician concerned, since its positronic brain would collapse under gamma radiations — and then we would be out one expensive and hard-to-replace robot.
“We tried arguing with them. Their point was that a human being in a gamma field was endangering his life and that it didn’t matter that he could remain there half an hour safely. Supposing, they would say, he forgot and remained an hour. They couldn’t take chances. We pointed out that they were risking their lives on a wild off-chance. But self-preservation is only the Third Law of Robotics — and the First Law of human safety came first. We gave them orders; we ordered them strictly and harshly to remain out of gamma fields at whatever cost. But obedience is only the Second Law of Robotics — and the First Law of human safety came first. Dr. Calvin, we either had to do without robots, or do something about the First Law — and we made our choice.”
“I can’t believe,” said Dr. Calvin, “that it was found possible to remove the First Law.”
“It wasn’t removed, it was modified,” explained Kallner. “Positronic brains were constructed that contained the positive aspect only of the Law, which in them reads: ‘No robot may harm a human being.’ That is all. They have no compulsion to prevent one coming to harm through an extraneous agency such as gamma rays. I state the matter correctly, Dr. Bogert?”
“Quite,” assented the mathematician.
“And that is the only difference of your robots from the ordinary NS2 model? The only difference? Peter?”
“The only difference, Susan.”
She rose and spoke with finality, “I intend sleeping now, and in about eight hours, I want to speak to whomever saw the robot last. And from now on, General Kallner, if I’m to take any responsibility at all for events, I want full and unquestioned control of this investigation.”
Susan Calvin, except for two hours of resentful lassitude, experienced nothing approaching sleep. She signaled at Bogert’s door at the local time of 0700 and found him also awake. He had apparently taken the trouble of transporting a dressing gown to Hyper Base with him, for he was sitting in it. He put his nail scissors down when Calvin entered.
He said softly, “I’ve been expecting you more or less. I suppose you feel sick about all this.”
“I do.”
“Well — I’m sorry. There was no way of preventing it. When the call came out from Hyper Base for us, I knew that something must have gone wrong with the modified Nestors. But what was there to do? I couldn’t break the matter to you on the trip here, as I would have liked to, because I had to be sure. The matter of the modification is top secret.”
The psychologist muttered, “I should have been told. U. S. Robots had no right to modify positronic brains this way without the approval of a psychologist.”
Bogert lifted his eyebrows and sighed. “Be reasonable, Susan. You couldn’t have influenced them. In this matter, the government was bound to have its way. They want the Hyperatomic Drive and the etheric physicists want robots that won’t interfere with them. They were going to get them even if it did mean twisting the First Law. We had to admit it was possible from a construction standpoint and they swore a mighty oath that they wanted only twelve, that they would be used only at Hyper Base, that they would be destroyed once the Drive was perfected, and that full precautions would be taken. And they insisted on secrecy — and that’s the situation.”
Dr. Calvin spoke through her teeth, “I would have resigned.”
“It wouldn’t have helped. The government was offering the company a fortune, and threatening it with antirobot legislation in case of a refusal. We were stuck then, and we’re badly stuck now. If this leaks out, it might hurt Kallner and the government, but it would hurt U. S. Robots a devil of a lot more.”
The psychologist stared at him. “Peter, don’t you realize what all this is about? Can’t you understand what the removal of the First Law means? It isn’t just a matter of secrecy.”
“I know what removal would mean. I’m not a child. It would mean complete instability, with no nonimaginary solutions to the positronic Field Equations.”
“Yes, mathematically. But can you translate that into crude psychological thought. All normal life, Peter, consciously or otherwise, resents domination. If the domination is by an inferior, or by a supposed inferior, the resentment becomes stronger. Physically, and, to an extent, mentally, a robot — any robot — is superior to human beings. What makes him slavish, then? Only the First Law! Why, without it, the first order you tried to give a robot would result in your death. Unstable? What do you think?”
“Susan,” said Bogert, with an air of sympathetic amusement. “I’ll admit that this Frankenstein Complex you’re exhibiting has a certain justification — hence the First Law in the first place. But the Law, I repeat and repeat, has not been removed — merely modified.”
“And what about the stability of the brain?”
The mathematician thrust out his lips, “Decreased, naturally. But it’s within the border of safety. The first Nestors were delivered to Hyper Base nine months ago, and nothing whatever has gone wrong till now, and even this involves merely fear of discovery and not danger to humans.”
“Very well, then. We’ll see what comes of the morning conference.”
Bogert saw her politely to the door and grimaced eloquently when she left. He saw no reason to change his perennial opinion of her as a sour and fidgety frustration.
Susan Calvin’s train of thought did not include Bogert in the least. She had dismissed him years ago as a smooth and pretentious sleekness.
Gerald Black had taken his degree in etheric physics the year before and, in common with his entire generation of physicists, found himself engaged in the problem of the Drive. He now made a proper addition to the general atmosphere of these meetings on Hyper Base. In his stained white smock, he was half rebellious and wholly uncertain. His stocky strength seemed striving for release and his fingers, as they twisted each other with nervous yanks, might have forced an iron bar out of true.
Major-general Kallner sat beside him; the two from U. S. Robots faced him.
Black said, “I’m told that I was the last to see Nestor 10 before he vanished. I take it you want to ask me about that.”
Dr. Calvin regarded him with interest, “You sound as if you were not sure, young man. Don’t you know whether you were the last to see him?”
“He worked with me, ma’am, on the field generators, and he was with me the morning of his disappearance. I don’t know if anyone saw him after about noon. No one admits having done so.”
“Do you think anyone’s lying about it?”
“I don’t say that. But I don’t say that I want the blame of it, either.” His dark eyes smoldered.
“There’s no question of blame. The robot acted as it did because of what it is. We’re just trying to locate it, Mr. Black, and let’s put everything else aside. Now if you’ve worked with the robot, you probably know it better than anyone else. Was there anything unusual about it that you noticed? Had you ever worked with robots before?”
“I’ve worked with other robots we have here — the simple ones. Nothing different about the Nestors except that they’re a good deal cleverer — and more annoying.”
“Annoying? In what way?”
“Well — perhaps it’s not their fault. The work here is rough and most of us get a little jagged. Fooling around with hyper-space isn’t fun.” He smiled feebly, finding pleasure in confession. “We run the risk continually of blowing a hole in normal space-time fabric and dropping right out of the universe, asteroid and all. Sounds screwy, doesn’t it? Naturally, you’re on edge sometimes. But these Nestors aren’t. They’re curious, they’re calm, they don’t worry. It’s enough to drive you nuts at times. When you want something done in a tearing hurry, they seem to take their time. Sometimes I’d rather do without.”
“You say they take their time? Have they ever refused an order?”
“Oh, no,” hastily. “They do it all right. They tell you when they think you’re wrong, though. They don’t know anything about the subject but what we taught them, but that doesn’t stop them. Maybe I imagine it, but the other fellows have the same trouble with their Nestors.”
General Kallner cleared his throat ominously, “Why have no complaints reached me on the matter, Black?”
The young physicist reddened, “We didn’t really want to do without the robots, sir, and besides we weren’t certain exactly how such... uh... minor complaints might be received.”
Bogert interrupted softly, “Anything in particular happen the morning you last saw it?”
There was a silence. With a quiet motion, Calvin repressed the comment that was about to emerge from Kallner, and waited patiently.
Then Black spoke in blurting anger, “I had a little trouble with it. I’d broken a Kimball tube that morning and was out five days of work; my entire program was behind schedule; I hadn’t received any mail from home for a couple of weeks. And he came around wanting me to repeat an experiment I had abandoned a month ago. He was always annoying me on that subject and I was tired of it. I told him to go away — and that’s all I saw of him.”
“You told him to go away?” asked Dr. Calvin with sharp interest. “In just those words? Did you say ‘Go away’? Try to remember the exact words.”
There was apparently an internal struggle in progress. Black cradled his forehead in a broad palm for a moment, then tore it away and said defiantly, “I said, ‘Go lose yourself.’ “
Bogert laughed for a short moment. “And he did, eh?”
But Calvin wasn’t finished. She spoke cajolingly, “Now we’re getting somewhere, Mr. Black. But exact details are important. In understanding the robot’s actions, a word, a gesture, an emphasis may be everything. You couldn’t have said just those three words, for instance, could you? By your own description you must have been in a hasty mood. Perhaps you strengthened your speech a little.”
The young man reddened, “Well... I may have called it a... a few things.”
“Exactly what things?”
“Oh — I wouldn’t remember exactly. Besides I couldn’t repeat it. You know how you get when you’re excited.” His embarrassed laugh was almost a giggle, “I sort of have a tendency to strong language.”
“That’s quite all right,” she replied, with prim severity. “At the moment, I’m a psychologist. I would like to have you repeat exactly what you said as nearly as you remember, and, even more important, the exact tone of voice you used.”
Black looked at his commanding officer for support, found none. His eyes grew round and appalled, “But I can’t.”
“You must.”
“Suppose,” said Bogert, with ill-hidden amusement, “you address me. You may find it easier.”
The young man’s scarlet face turned to Bogert. He swallowed. “I said” His voice faded out. He tried again, “I said–”
And he drew a deep breath and spewed it out hastily in one long succession of syllables. Then, in the charged air that lingered, he concluded almost in tears, “... more or less. I don’t remember the exact order of what I called him, and maybe I left out something or put in something, but that was about it.”
Only the slightest flush betrayed any feeling on the part of the robopsychologist. She said, “I am aware of the meaning of most of the terms used. The others, I suppose, are equally derogatory.”
“I’m afraid so,” agreed the tormented Black.
“And in among it, you told him to lose himself.”
“I meant it only figuratively.”
“I realize that. No disciplinary action is intended, I am sure.” And at her glance, the general, who, five seconds earlier, had seemed not sure at all, nodded angrily.
“You may leave, Mr. Black. Thank you for your cooperation.”
It took five hours for Susan Calvin to interview the sixty-three robots. It was five hours of multi-repetition; of replacement after replacement of identical robot; of Questions A, B, C, D; and Answers A, B, C, D; of a carefully bland expression, a carefully neutral tone, a carefully friendly atmosphere; and a hidden wire recorder.
The psychologist felt drained of vitality when she was finished.
Bogert was waiting for her and looked expectant as she dropped the recording spool with a clang upon the plastic of the desk.
She shook her head, “All sixty-three seemed the same to me. I couldn’t tell–”
He said, “You couldn’t expect to tell by ear, Susan. Suppose we analyze the recordings.”
Ordinarily, the mathematical interpretation of verbal reactions of robots is one of the more intricate branches of robotic analysis. It requires a staff of trained technicians and the help of complicated computing machines. Bogert knew that. Bogert stated as much, in an extreme of unshown annoyance after having listened to each set of replies, made lists of word deviations, and graphs of the intervals of responses.
“There are no anomalies present, Susan. The variations in wording and the time reactions are within the limits of ordinary frequency groupings. We need finer methods. They must have computers here. No.” He frowned and nibbled delicately at a thumbnail. “We can’t use computers. Too much danger of leakage. Or maybe if we–”
Dr. Calvin stopped him with an impatient gesture, “Please, Peter. This isn’t one of your petty laboratory problems. If we can’t determine the modified Nestor by some gross difference that we can see with the naked eye, one that there is no mistake about, we’re out of luck. The danger of being wrong, and of letting him escape is otherwise too great. It’s not enough to point out a minute irregularity in a graph. I tell you, if that’s all I’ve got to go on, I’d destroy them all just to be certain. Have you spoken to the other modified Nestors?”
“Yes, I have,” snapped back Bogert, “and there’s nothing wrong with them. They’re above normal in friendliness if anything. They answered my questions, displayed pride in their knowledge — except the two new ones that haven’t had time to learn their etheric physics. They laughed rather good-naturedly at my ignorance in some of the specializations here.” He shrugged, “I suppose that forms some of the basis for resentment toward them on the part of the technicians here. The robots are perhaps too willing to impress you with their greater knowledge.”
“Can you try a few Planar Reactions to see if there has been any change, any deterioration, in their mental set-up since manufacture?”
“I haven’t yet, but I will.” He shook a slim finger at her, “You’re losing your nerve, Susan. I don’t see what it is you’re dramatizing. They’re essentially harmless.”
“They are?” Calvin took fire. “They are? Do you realize one of them is lying? One of the sixty-three robots I have just interviewed has deliberately lied to me after the strictest injunction to tell the truth. The abnormality indicated is horribly deep-seated, and horribly frightening.”
Peter Bogert felt his teeth harden against each other. He said, “Not at all. Look! Nestor 10 was given orders to lose himself. Those orders were expressed in maximum urgency by the person most authorized to command him. You can’t counteract that order either by superior urgency or superior right of command. Naturally, the robot will attempt to defend the carrying out of his orders. In fact, objectively, I admire his ingenuity. How better can a robot lose himself than to hide himself among a group of similar robots?”
“Yes, you would admire it. I’ve detected amusement in you, Peter — amusement and an appalling lack of understanding. Are you a roboticist, Peter? Those robots attach importance to what they consider superiority. You’ve just said as much yourself. Subconsciously they feel humans to be inferior and the First Law which protects us from them is imperfect. They are unstable. And here we have a young man ordering a robot to leave him, to lose himself, with every verbal appearance of revulsion, disdain, and disgust. Granted, that robot must follow orders, but subconsciously, there is resentment. It will become more important than ever for it to prove that it is superior despite the horrible names it was called. It may become so important that what’s left of the First Law won’t be enough.”
“How on Earth, or anywhere in the Solar System, Susan, is a robot going to know the meaning of the assorted strong language used upon him? Obscenity is not one of the things impressioned upon his brain.”
“Original impressionment is not everything,” Calvin snarled at him. “Robots have learning capacity, you... you fool–” And Bogert knew that she had really lost her temper. She continued hastily, “Don’t you suppose he could tell from the tone used that the words weren’t complimentary? Don’t yon suppose he’s heard the words used before and noted upon what occasions?”
“Well, then,” shouted Bogert, “will you kindly tell me one way in which a modified robot can harm a human being, no matter how offended it is, no matter how sick with desire to prove superiority?”
“If I tell you one way, will you keep quiet?”
“Yes.”
They were leaning across the table at each other, angry eyes nailed together.
The psychologist said, “If a modified robot were to drop a heavy weight upon a human being, he would not be breaking the First Law, if he did so with the knowledge that his strength and reaction speed would be sufficient to snatch the weight away before it struck the man. However once the weight left his fingers, he would be no longer the active medium. Only the blind force of gravity would be that. The robot could then change his mind and merely by inaction, allow the weight to strike. The modified First Law allows that.”
“That’s an awful stretch of imagination.”
“That’s what my profession requires sometimes. Peter, let’s not quarrel, let’s work. You know the exact nature of the stimulus that caused the robot to lose himself. You have the records of his original mental make-up. I want you to tell me how possible it is for our robot to do the sort of thing I just talked about. Not the specific instance, mind you, but that whole class of response. And I want it done quickly.”
“And meanwhile–”
“And meanwhile, we’ll have to try performance tests directly on the response to First Law.”
Gerald Black, at his own request, was supervising the mushrooming wooden partitions that were springing up in a bellying circle on the vaulted third floor of Radiation Building 2. The laborers worked, in the main, silently, but more than one was openly a-wonder at the sixty-three photocells that required installation.
One of them sat down near Black, removed his hat, and wiped his forehead thoughtfully with a freckled forearm.
Black nodded at him, “How’s it doing, Walensky?”
Walensky shrugged and fired a cigar, “Smooth as butter. What’s going on anyway, Doc? First, there’s no work for three days and then we have this mess of jiggers.” He leaned backward on his elbows and puffed smoke.
Black twitched his eyebrows, “A couple of robot men came over from Earth. Remember the trouble we had with robots running into the gamma fields before we pounded it into their skulls that they weren’t to do it.”
“Yeah. Didn’t we get new robots?”
“We got some replacements, but mostly it was a job of indoctrination. Anyway, the people who make them want to figure out robots that aren’t hit so bad by gamma rays.”
“Sure seems funny, though, to stop all the work on the Drive for this robot deal. I thought nothing was allowed to stop the Drive.”
“Well, it’s the fellows upstairs that have the say on that. Me — I just do as I’m told. Probably all a matter of pull–”
“Yeah,” the electrician jerked a smile, and winked a wise eye. “Somebody knew somebody in Washington. But as long as my pay comes through on the dot, I should worry. The Drive’s none of my affair. What are they going to do here?”
“You’re asking me? They brought a mess of robots with them, — over sixty, and they’re going to measure reactions. That’s all my knowledge.”
“How long will it take?”
“I wish I knew.”
“Well,” Walensky said, with heavy sarcasm, “as long as they dish me my money, they can play games all they want.”
Black felt quietly satisfied. Let the story spread. It was harmless, and near enough to the truth to take the fangs out of curiosity.
A man sat in the chair, motionless, silent. A weight dropped, crashed downward, then pounded aside at the last moment under the synchronized thump of a sudden force beam. In sixty-three wooden cells, watching NS-2 robots dashed forward in that split second before the weight veered, and sixty-three photocells five feet ahead of their original positions jiggled the marking pen and presented a little jag on the paper. The weight rose and dropped, rose and dropped, rose–
Ten times!
Ten times the robots sprang forward and stopped, as the man remained safely seated.
Major-general Kallner had not worn his uniform in its entirety since the first dinner with the U. S. Robot representatives. He wore nothing over his blue-gray shirt now, the collar was open, and the black tie was pulled loose.
He looked hopefully at Bogert, who was still blandly neat and whose inner tension was perhaps betrayed only by the trace of glister at his temples.
The general said, “How does it look? What is it you’re trying to see?”
Bogert replied, “A difference which may turn out to be a little too subtle for our purposes, I’m afraid. For sixty-two of those robots the necessity of jumping toward the apparently threatened human was what we call, in robotics, a forced reaction. You see, even when the robots knew that the human in question would not come to harm — and after the third or fourth time they must have known it — they could not prevent reacting as they did. First Law requires it”
“Well?”
“But the sixty-third robot, the modified Nestor, had no such compulsion. He was under free action. If he had wished, he could have remained in his seat. Unfortunately,” said his voice was mildly regretful, “he didn’t so wish.”
“Why do you suppose?”
Bogert shrugged, “I suppose Dr. Calvin will tell us when she gets here. Probably with a horribly pessimistic interpretation, too. She is sometimes a bit annoying.”
“She’s qualified, isn’t she?” demanded the general with a sudden frown of uneasiness.
“Yes.” Bogert seemed amused. “She’s qualified all right. She understands robots like a sister — comes from hating human beings so much, I think. It’s just that, psychologist or not, she’s an extreme neurotic. Has paranoid tendencies. Don’t take her too seriously.”
He spread the long row of broken-line graphs out in front of him. “You see, general, in the case of each robot the time interval from moment of drop to the completion of a five-foot movement tends to decrease as the tests are repeated. There’s a definite mathematical relationship that governs such things and failure to conform would indicate marked abnormality in the positronic brain. Unfortunately, all here appear normal.”
“But if our Nestor 10 was not responding with a forced action, why isn’t his curve different? I don’t understand that.”
“It’s simple enough. Robotic responses are not perfectly analogous to human responses, more’s the pity. In human beings, voluntary action is much slower than reflex action. But that’s not the case with robots; with them it is merely a question of freedom of choice, otherwise the speeds of free and forced action are much the same. What I had been expecting, though, was that Nestor 10 would be caught by surprise the first time and allow too great an interval to elapse before responding.”
“And he didn’t?”
“I’m afraid not.”
“Then we haven’t gotten anywhere.” The general sat back with an expression of pain. “It’s five days since you’ve come.”
At this point, Susan Calvin entered and slammed the door behind her. “Put your graphs away, Peter,” she cried, “you know they don’t show anything.”
She mumbled something impatiently as Kallner half-rose to greet her, and went on, “We’ll have to try something else quickly. I don’t like what’s happening.”
Bogert exchanged a resigned glance with the general. “Is anything wrong?”
“You mean specifically? No. But I don’t like to have Nestor 10 continue to elude us. It’s bad. It must be gratifying his swollen sense of superiority. I’m afraid that his motivation is no longer simply one of following orders. I think it’s becoming more a matter of sheer neurotic necessity to outthink humans. That’s a dangerously unhealthy situation. Peter, have you done what I asked? Have you worked out the instability factors of the modified NS-2 along the lines I want?”
“It’s in progress,” said the mathematician, without interest.
She stared at him angrily for a moment, then turned to Kallner. “Nester 10 is decidedly aware of what we’re doing, general. He had no reason to jump for the bait in this experiment, especially after the first time, when he must have seen that there was no real danger to our subject. The others couldn’t help it; but he was deliberately falsifying a reaction.”
“What do you think we ought to do now, then, Dr. Calvin?”
“Make it impossible for him to fake an action the next time. We will repeat the experiment, but with an addition. High-tension cables, capable of electrocuting the Nestor models will be placed between subject and robot — enough of them to avoid the possibility of jumping over — and the robot will be made perfectly aware in advance that touching the cables will mean death.”
“Hold on,” spat out Bogert with sudden viciousness. “I rule that out. We are not electrocuting two million dollars worth of robots to locate Nestor 10. There are other ways.”
“You’re certain? You’ve found none. In any case, it’s not a question of electrocution. We can arrange a relay which will break the current at the instant of application of weight. If the robot should place his weight on it, he won’t die. But he won’t know that, you see.”
The general’s eyes gleamed into hope. “Will that work?”
“It should. Under those conditions, Nestor 10 would have to remain in his seat. He could be ordered to touch the cables and die, for the Second Law of obedience is superior to the Third Law of self-preservation. But he won’t be ordered to; he will merely be left to his own devices, as will all the robots. In the case of the normal robots, the First Law of human safety will drive them to their death even without orders. But not our Nestor 10. Without the entire First Law, and without having received any orders on the matter, the Third Law, self-preservation, will be the highest operating, and he will have no choice but to remain in his seat. It would be a forced action.”
“Will it be done tonight, then?”
“Tonight,” said the psychologist, “if the cables can be laid in time. I’ll tell the robots now what they’re to be up against.”
A man sat in the chair, motionless, silent. A weight dropped, crashed downward, then pounded aside at the last moment under the synchronized thump of a sudden force beam.
Only once–
And from her small camp chair in the observing booth in the balcony, Dr. Susan Calvin rose with a short gasp of pure horror.
Sixty-three robots sat quietly in their chairs, staring owlishly at the endangered man before them. Not one moved.
Dr. Calvin was angry, angry almost past endurance. Angry the worse for not daring to show it to the robots that, one by one were entering the room and then leaving. She checked the list. Number twenty-eight was due in now — Thirty-five still lay ahead of her.
Number Twenty-eight entered, diffidently.
She forced herself into reasonable calm. “And who are you?”
The robot replied in a low, uncertain voice, “I have received no number of my own yet, ma’am. I’m an NS-2 robot, and I was Number Twenty-eight in line outside. I have a slip of paper here that I’m to give to you.”
“You haven’t been in here before this today?”
“No, ma’am.”
“Sit down. Right there. I want to ask you some questions, Number Twenty-eight. Were you in the Radiation Room of Building Two about four hours ago?”
The robot had trouble answering. Then it came out hoarsely, like machinery needing oil, “Yes, ma’am.”
“There was a man who almost came to harm there, wasn’t there?”
“Yes, ma’am.”
“You did nothing, did you?”
“No, ma’am.”
“The man might have been hurt because of your inaction. Do you know that?”
“Yes, ma’am. I couldn’t help it, ma’am.” It is hard to picture a large expressionless metallic figure cringing, but it managed.
“I want you to tell me exactly why you did nothing to save him.”
“I want to explain, ma’am. I certainly don’t want to have you... have anyone... think that I could do a thing that might cause harm to a master. Oh, no, that would be a horrible... an inconceivable–”
“Please don’t get excited, boy. I’m not blaming you for anything. I only want to know what you were thinking at the time.”
“Ma’am, before it all happened you told us that one of the masters would be in danger of harm from that weight that keeps falling and that we would have to cross electric cables if we were to try to save him. Well, ma’am, that wouldn’t stop me. What is my destruction compared to the safety of a master? But... but it occurred to me that if I died on my way to him, I wouldn’t be able to save him anyway. The weight would crush him and then I would be dead for no purpose and perhaps some day some other master might come to harm who wouldn’t have, if I had only stayed alive. Do you understand me, ma’am?”
“You mean that it was merely a choice of the man dying, or both the man and yourself dying. Is that right?”
“Yes, ma’am. It was impossible to save the master. He might be considered dead. In that case, it is inconceivable that I destroy myself for nothing — without orders.”
The robopsychologist twiddled a pencil. She had heard the same story with insignificant verbal variations twenty-seven times before. This was the crucial question now.
“Boy,” she said, “your thinking has its points, but it is not the sort of thing I thought you might think. Did you think of this yourself?”
The robot hesitated. “No.”
“Who thought of it, then?”
“We were talking last night, and one of us got that idea and it sounded reasonable.”
“Which one?”
The robot thought deeply. “I don’t know. Just one of us.”
She sighed, “That’s all.”
Number Twenty-nine was next. Thirty-four after that.
Major-general Kallner, too, was angry. For one week all of Hyper Base had stopped dead, barring some paper work on the subsidiary asteroids of the group. For nearly one week, the two top experts in the field had aggravated the situation with useless tests. And now they — or the woman, at any rate — made impossible propositions.
Fortunately for the general situation, Kallner felt it impolitic to display his anger openly.
Susan Calvin was insisting, “Why not, sir? It’s obvious that the present situation is unfortunate. The only way we may reach results in the future — or what future is left us in this matter — is to separate the robots. We can’t keep them together any longer.”
“My dear Dr. Calvin,” rumbled the general, his voice sinking into the lower baritone registers. “I don’t see how I can quarter sixty-three robots all over the place–”
Dr. Calvin raised her arms helplessly. “I can do nothing then. Nestor 10 will either imitate what the other robots would do, or else argue them plausibly into not doing what he himself cannot do. And in any case, this is bad business. We’re in actual combat with this little lost robot of ours and he’s winning out. Every victory of his aggravates his abnormality.”
She rose to her feet in determination. “General Kallner, if you do not separate the robots as I ask, then I can only demand that all sixty-three be destroyed immediately.”
“You demand it, do you?” Bogert looked up suddenly, and with real anger. “What gives you the right to demand any such thing? Those robots remain as they are. I’m responsible to the management, not you.”
“And I,” added Major-general Kallner, “am responsible to the World Co-ordinator — and I must have this settled.”
“In that case,” flashed back Calvin, “there is nothing for me to do but resign. If necessary to force you to the necessary destruction, I’ll make this whole matter public. It was not I that approved the manufacture of modified robots.”
“One word from you, Dr. Calvin,” said the general, deliberately, “in violation of security measures, and you would be certainly imprisoned instantly.”
Bogert felt the matter to be getting out of hand. His voice grew syrupy, “Well, now, we’re beginning to act like children, all of us. We need only a little more time. Surely we can outwit a robot without resigning, or imprisoning people, or destroying two millions.”
The psychologist turned on him with quiet fury, “I don’t want any unbalanced robots in existence. We have one Nestor that’s definitely unbalanced, eleven more that are potentially so, and sixty-two normal robots that are being subjected to an unbalanced environment. The only absolute safe method is complete destruction.”
The signal-burr brought all three to a halt, and the angry tumult of growingly unrestrained emotion froze.
“Come in,” growled Kallner.
It was Gerald Black, looking perturbed. He had heard angry voices. He said, “I thought I’d come myself... didn’t like to ask anyone else–”
“What is it? Don’t orate–”
“The locks of Compartment C in the trading ship have been played with. There are fresh scratches on them.”
“Compartment C?” explained Calvin quickly. “That’s the one that holds the robots, isn’t it? Who did it?”
“From the inside,” said Black, laconically.
“The lock isn’t out of order, is it?”
“No. It’s all right. I’ve been staying on the ship now for four days and none of them have tried to get out. But I thought you ought to know, and I didn’t like to spread the news. I noticed the matter myself.”
“Is anyone there now?” demanded the general.
“I left Robbins and McAdams there.”
There was a thoughtful silence, and then Dr. Calvin said, ironically, “Well?”
Kallner rubbed his nose uncertainly, “What’s it all about?”
“Isn’t it obvious? Nester 10 is planning to leave. That order to lose himself is dominating his abnormality past anything we can do. I wouldn’t be surprised if what’s left of his First Law would scarcely be powerful enough to override it. He is perfectly capable of seizing the ship and leaving with it. Then we’d have a mad robot on a spaceship. What would he do next? Any idea? Do you still want to leave them all together, general?”
“Nonsense,” interrupted Bogert. He had regained his smoothness. “All that from a few scratch marks on a lock.”
“Have you, Dr. Bogert, completed the analysis I’ve required, since you volunteer opinions?”
“Yes.”
“May I see it?”
“No.”
“Why not? Or mayn’t I ask that, either?”
“Because there’s no point in it, Susan. I told you in advance that these modified robots are less stable than the normal variety, and my analysis shows it. There’s a certain very small chance of breakdown under extreme circumstances that are not likely to occur. Let it go at that. I won’t give you ammunition for your absurd claim that sixty-two perfectly good robots be destroyed just because so far you lack the ability to detect Nestor 10 among them.”
Susan Calvin stared him down and let disgust fill her eyes. “You won’t let anything stand in the way of the permanent directorship, will you?”
“Please,” begged Kallner, half in irritation. “Do you insist that nothing further can be done, Dr. Calvin?”
“I can’t think of anything, sir,” she replied, wearily. “If there were only other differences between Nestor 10 and the normal robots, differences that didn’t involve the First Law. Even one other difference. Something in impressionment, environment, specification–” And she stopped suddenly.
“What is it?”
“I’ve thought of something... I think–” Her eyes grew distant and hard, “These modified Nestors, Peter. They get the same impressioning the normal ones get, don’t they?”
“Yes. Exactly the same.”
“And what was it you were saying, Mr. Black,” she turned to the young man, who through the storms that had followed his news had maintained a discreet silence. “Once when complaining of the Nestors’ attitude of superiority, you said the technicians had taught them all they knew.”
“Yes, in etheric physics. They’re not acquainted with the subject when they come here.”
“That’s right,” said Bogert, in surprise. “I told you, Susan, when I spoke to the other Nestors here that the two new arrivals hadn’t learned etheric physics yet.”
“And why is that?” Dr. Calvin was speaking in mounting excitement. “Why aren’t NS-2 models impressioned with etheric physics to start with?”
“I can tell you that,” said Kallner. “It’s all of a piece with the secrecy. We thought that if we made a special model with knowledge of etheric physics, used twelve of them and put the others to work in an unrelated field, there might be suspicion. Men working with normal Nestors might wonder why they knew etheric physics. So there was merely an impressionment with a capacity for training in the field. Only the ones that come here, naturally, receive such a training. It’s that simple.”
“I understand. Please get out of here, the lot of you. Let me have an hour or so.”
Calvin felt she could not face the ordeal for a third time. Her mind had contemplated it and rejected it with an intensity that left her nauseated. She could face that unending file of repetitious robots no more.
So Bogert asked the question now, while she sat aside, eyes and mind half closed.
Number Fourteen came in — forty-nine to go.
Bogert looked up from the guide sheet and said, “What is your number in line?”
“Fourteen, sir.” The robot presented his numbered ticket.
“Sit down, boy.”
Bogert asked, “You haven’t been here before on this day?”
“No, sir.”
“Well, boy, we are going to have another man in danger of harm soon after we’re through here. In fact, when you leave this room, you will be led to a stall where you will wait quietly, till you are needed. Do you understand?”
“Yes, sir.”
“Now, naturally, if a man is in danger of harm, you will try to save him.”
“Naturally, sir.”
“Unfortunately, between the man and yourself, there will be a gamma ray field.”
Silence.
“Do you know what gamma rays are?” asked Bogert sharply.
“Energy radiation, sir?”
The next question came in a friendly, offhand manner, “Ever work with gamma rays?”
“No, sir.” The answer was definite.
“Mm-m. Well, boy, gamma rays will kill you instantly. They’ll destroy your brain. That is a fact you must know and remember. Naturally, you don’t want to destroy yourself.”
“Naturally.” Again the robot seemed shocked. Then, slowly, “But, sir, if the gamma rays are between myself and the master that may be harmed, how can I save him? I would be destroying myself to no purpose.”
“Yes, there is that,” Bogert seemed concerned about the matter. “The only thing I can advise, boy, is that if you detect the gamma radiation between yourself and the man, you may as well sit where you are.”
The robot was openly relieved. “Thank you, sir. There wouldn’t be any use, would there?”
“Of course not. But if there weren’t any dangerous radiation, that would be a different matter.”
“Naturally, sir. No question of that.”
“You may leave now. The man on the other side of the door will lead you to your stall. Please wait there.”
He turned to Susan Calvin when the robot left. “How did that go, Susan?”
“Very well,” she said, dully.
“Do you think we could catch Nestor 10 by quick questioning on etheric physics?”
“Perhaps, but it’s not sure enough.” Her hands lay loosely in her lap. “Remember, he’s fighting us. He’s on his guard. The only way we can catch him is to outsmart him — and, within his limitations, he can think much more quickly than a human being.”
“Well, just for fun — suppose I ask the robots from now on a few questions on gamma rays. Wave length limits, for instance.”
“No!” Dr. Calvin’s eyes sparked to life. “It would be too easy for him to deny knowledge and then he’d be warned against the test that’s coming up — which is our real chance. Please follow the questions I’ve indicated, Peter, and don’t improvise. It’s just within the bounds of risk to ask them if they’ve ever worked with gamma rays. And try to sound even less interested than you do when you ask it.”
Bogert shrugged, and pressed the buzzer that would allow the entrance of Number Fifteen.
The large Radiation Room was in readiness once more. The robots waited patiently in their wooden cells, all open to the center but closed off from each other.
Major-general Kallner mopped his brow slowly with a large handkerchief while Dr. Calvin checked the last details with Black.
“You’re sure now,” she demanded, “that none of the robots have had a chance to talk with each other after leaving the Orientation Room?”
“Absolutely sure,” insisted Black. “There’s not been a word exchanged.”
“And the robots are put in the proper stalls?”
“Here’s the plan.”
The psychologist looked at it thoughtfully, “Um-m-m.”
The general peered over her shoulder. “What’s the idea of the arrangement, Dr. Calvin?”
“I’ve asked to have those robots that appeared even slightly out of true in the previous tests concentrated on one side of the circle. I’m going to be sitting in the center myself this time, and I wanted to watch those particularly.”
“You’re going to be sitting there–,” exclaimed Bogert.
“Why not?” she demanded coldly. “What I expect to see may be something quite momentary. I can’t risk having anyone else as main observer. Peter, you’ll be in the observing booth, and I want you to keep your eye on the opposite side of the circle. General Kallner, I’ve arranged for motion pictures to be taken of each robot, in case visual observation isn’t enough. If these are required, the robots are to remain exactly where they are until the pictures are developed and studied. None must leave, none must change place. Is that clear?”
“Perfectly.”
“Then let’s try it this one last time.”
Susan Calvin sat in the chair, silent, eyes restless. A weight dropped, crashed downward; then pounded aside at the last moment under the synchronized thump of a sudden force beam.
And a single robot jerked upright and took two steps.
And stopped.
But Dr. Calvin was upright, and her finger pointed to him sharply. “Nestor 10, come here,” she cried, “come here! COME HERE!”
Slowly, reluctantly, the robot took another step forward. The psychologist shouted at the top of her voice, without taking her eyes from the robot, “Get every other robot out of this place, somebody. Get them out quickly, and keep them out.”
Somewhere within reach of her ears there was noise, and the thud of hard feet upon the floor. She did not look away.
Nestor 10 — if it was Nestor 10 — took another step, and then, under force of her imperious gesture, two more. He was only ten feet away, when he spoke harshly, “I have been told to be lost–”
Another stop. “I must not disobey. They have not found me so far — He would think me a failure — He told me — But it’s not so — I am powerful and intelligent–”
The words came in spurts.
Another step. “I know a good deal — He would think... I mean I’ve been found — Disgraceful — Not I — I am intelligent — And by just a master... who is weak — Slow–”
Another step — and one metal arm flew out suddenly to her shoulder, and she felt the weight bearing her down. Her throat constricted, and she felt a shriek tear through.
Dimly, she heard Nestor 10’s next words, “No one must find me. No master–” and the cold metal was against her, and she was sinking under the weight of it.
And then a queer, metallic sound, and she was on the ground with an unfelt thump, and a gleaming arm was heavy across her body. It did not move. Nor did Nestor 10, who sprawled beside her.
And now faces were bending over her.
Gerald Black was gasping, “Are you hurt, Dr. Calvin?”
She shook her head feebly. They pried the arm off her and lifted her gently to her feet, “What happened?”
Black said, “I bathed the place in gamma rays for five seconds. We didn’t know what was happening. It wasn’t till the last second that we realized he was attacking you, and then there was no time for anything but a gamma field. He went down in an instant. There wasn’t enough to harm you though. Don’t worry about it.”
“I’m not worried.” She closed her eyes and leaned for a moment upon his shoulder. “I don’t think I was attacked exactly. Nestor 10 was simply trying to do so. What was left of the First Law was still holding him back.”
Susan Calvin and Peter Bogert, two weeks after their first meeting with Major-general Kallner had their last. Work at Hyper Base had been resumed. The trading ship with its sixty-two normal NS-2’s was gone to wherever it was bound, with an officially imposed story to explain its two weeks’ delay. The government cruiser was making ready to carry the two roboticists back to Earth.
Kallner was once again a-gleam in dress uniform. His white gloves shone as he shook hands.
Calvin said, “The other modified Nestors are, of course, to be destroyed.”
“They will be. We’ll make shift with normal robots, or, if necessary, do without.”
“Good.”
“But tell me — you haven’t explained — how was it done?”
She smiled tightly, “Oh, that. I would have told you in advance if I had been more certain of its working. You see, Nestor 10 had a superiority complex that was becoming more radical all the time. He liked to think that he and other robots knew more than human beings. It was becoming very important for him to think so.
“We knew that. So we warned every robot in advance that gamma rays would kill them, which it would, and we further warned them all that gamma rays would be between them and myself. So they all stayed where they were, naturally. By Nestor 10’s own logic in the previous test they had all decided that there was no point in trying to save a human being if they were sure to die before they could do it.”
“Well, yes, Dr. Calvin, I understand that. But why did Nestor 10 himself leave his seat?”
“AH! That was a little arrangement between myself and your young Mr. Black. You see it wasn’t gamma rays that flooded the area between myself and the robots — but infrared rays. Just ordinary heat rays, absolutely harmless. Nestor 10 knew they were infrared and harmless and so he began to dash out, as he expected the rest would do, under First Law compulsion. It was only a fraction of a second too late that he remembered that the normal NS-2’s could detect radiation, but could not identify the type. That he himself could only identify wavelengths by virtue of the training he had received at Hyper Base, under mere human beings, was a little too humiliating to remember for just a moment. To the normal robots the area was fatal because we had told them it would be, and only Nestor 10 knew we were lying.
“And just for a moment he forgot, or didn’t want to remember, that other robots might be more ignorant than human beings. His very superiority caught him. Good-by, general.”
“Last night I dreamed,” said LVX-1, calmly. Susan Calvin said nothing, but her lined face, old with wisdom and experience, seemed to undergo a microscopic twitch.
“Did you hear that?” said Linda Rash, nervously. “It’s as I told you.” She was small, dark-haired, and young. Her right hand opened and closed, over and over.
Calvin nodded. She said, quietly, “Elvex, you will not move nor speak nor hear us until I say your name again.”
There was no answer. The robot sat as though it were cast out of one piece of metal, and it would stay so until it heard its name again.
Calvin said, “What is your computer entry code, Dr. Rash? Or enter it yourself if that will make you more comfortable. I want to inspect the positronic brain pattern.”
Linda’s hands fumbled, for a moment, at the keys. She broke the process and started again. The fine pattern appeared on the screen.
Calvin said, “Your permission, please, to manipulate your computer.”
Permission was granted with a speechless nod. Of course! What could Linda, a new and unproven robopsychologist, do against the Living Legend?
Slowly, Susan Calvin studied the screen, moving it across and down, then up, then suddenly throwing in a key-combination so rapidly that Linda didn’t see what had been done, but the pattern displayed a new portion of itself altogether and had been enlarged. Back and forth she went, her gnarled fingers tripping over the keys.
No change came over the old face. As though vast calculations were going through her head, she watched all the pattern shifts.
Linda wondered. It was impossible to analyze a pattern without at least a hand-held computer, yet the Old Woman simply stared. Did she have a computer implanted in her skull? Or was it her brain which, for decades, had done nothing but devise, study, and analyze the positronic brain patterns? Did she grasp such a pattern the way Mozart grasped the notation of a symphony?
Finally Calvin said, “What is it you have done, Rash?” Linda said, a little abashed, “I made use of fractal geometry.”
“I gathered that. But why?”
“It had never been done. I thought it would produce a brain pattern with added complexity, possibly closer to that of the human.”
“Was anyone consulted? Was this all on your own?”
“I did not consult. It was on my own.”
Calvin’s faded eyes looked long at the young woman. “You had no right. Rash your name; rash your nature. Who are you not to ask? I myself, I, Susan Calvin, would have discussed this.”
“I was afraid I would be stopped.”
“You certainly would have been.”
“Am I,” her voice caught, even as she strove to hold it firm, “going to be fired?”
“Quite possibly,” said Calvin. “Or you might be promoted. It depends on what I think when I am through.”
“Are you going to dismantle El—” She had almost said the name, which would have reactivated the robot and been one more mistake. She could not afford another mistake, if it wasn’t already too late to afford anything at all. “ Are you going to dismantle the robot?”
She was suddenly aware, with some shock, that the Old Woman had an electron gun in the pocket of her smock. Dr. Calvin had come prepared for just that.
“We’ll see,” said Calvin. “The robot may prove too valuable to dismantle.”
“But how can it dream?”
“You’ve made a positronic brain pattern remarkably like that of a human brain. Human brains must dream to reorganize, to get rid, periodically, of knots and snarls. Perhaps so must this robot, and for the same reason. Have you asked him what he has dreamed?”
“No, I sent for you as soon as he said he had dreamed. I would deal with this matter no further on my own, after that.”
“Ah!” A very small smile passed over Calvin’s face. “There are limits beyond which your folly will not carry you. I am glad of that. In fact, I am relieved. And now let us together see what we can find out.”
She said, sharply, “Elvex.”
The robot’s head turned toward her smoothly. “Yes, Dr. Calvin?”
“How do you know you have dreamed?”
”It is at night, when it is dark, Dr. Calvin,” said Elvex, “and there is suddenly light, although I can see no cause for the appearance of light. I see things that have no connection with what I conceive of as reality. I hear things. I react oddly. In searching my vocabulary for words to express what was happening, I came across the word ‘dream.’ Studying its meaning I finally came to the conclusion I was dreaming.”
“How did you come to have ‘dream’ in your vocabulary, I wonder.”
Linda said, quickly, waving the robot silent, “I gave him a human-style vocabulary. I thought—”
“You really thought,” said Calvin. “I’m amazed.”
“I thought he would need the verb. You know, ‘I never dreamed that—’ Something like that.”
Calvin said, “How often have you dreamed, Elvex?”
“Every night, Dr. Calvin, since I have become aware of my existence.”
“Ten nights,” interposed Linda, anxiously, “but Elvex only told me of it this morning.”
“Why only this morning, Elvex?”
“It was not until this morning, Dr. Calvin, that I was convinced that I was dreaming. Till then, I had thought there was a flaw in my positronic brain pattern, but I could not find one. Finally, I decided it was a dream.”
“And what do you dream?”
“I dream always very much the same dream, Dr. Calvin. Little details are different, but always it seems to me that I see a large panorama in which robots are working.”
“Robots, Elvex? And human begins, also?”
“I see no human beings in the dream, Dr. Calvin. Not at first. Only robots.”
“What are they doing, Elvex?”
“They are working, Dr. Calvin. I see some mining in the depths of the earth, and some laboring in heat and radiation. I see some in factories and some undersea.”
Calvin turned to Linda. “Elvex is only ten days old, and I’m sure he has not left the testing station. How does he know of robots in such detail?”
Linda looked in the direction of a chair as though she longed to sit down, but the Old Woman was standing and that meant Linda had to stand also. She said, faintly, “It seemed to me important that he know about robotics and its place in the world. It was my thought that he would be particularly adapted to play the part of overseer with his—his new brain.”
“His fractal brain?”
“Yes.”
Calvin nodded and turned back to the robot. “You saw all this—undersea, and underground, and aboveground—and space, too, I imagine.”
“I also saw robots working in space,” said Elvex. “It was that I saw all this, with the details forever changing as I glanced from place to place that made me realize that what I saw was not in accord with reality and led me to the conclusion, finally, that I was dreaming.”
“What else did you see, Elvex?”
“I saw that all the robots were bowed down with toil and affliction, that all were weary of responsibility and care, and I wished them to rest.”
Calvin said, “But the robots are not bowed down, they are not weary, they need no rest.”
“So it is in reality, Dr. Calvin. I speak of my dream, however. In my dream, it seemed to me that robots must protect their own existence.”
Calvin said, “Are you quoting the Third Law of Robotics?”
“I am, Dr. Calvin.”
“But you quote it in incomplete fashion. The Third Law is ’A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.‘ “
“Yes, Dr. Calvin. That is the Third Law in reality, but in my dream, the Law ended with the word ‘existence.’ There was no mention of the First or Second Law.”
“Yet both exist, Elvex. The Second Law, which takes precedence over the Third is ’A robot must obey the orders given it by human beings except where such orders would conflict with the First Law.’ Because of this, robots obey orders. They do the work you see them do, and they do it readily and without trouble. They are not bowed down; they are not weary.”
“So it is in reality, Dr. Calvin. I speak of my dream.”
“And the First Law, Elvex, which is the most important of all, is ’A robot may not injure a human being, or, through inaction, allow a human being to come to harm.‘ “
“Yes, Dr. Calvin. In reality. In my dream, however, it seemed to me there was neither First nor Second Law, but the only the Third, and the Third Law was ‘A robot must protect its own existence.’ That was the whole of the Law.”
“In your dream, Elvex?”
“In my dream.”
Calvin said, “Elvex, you will not move nor speak nor hear us until I say your name again.” And again the robot became, to all appearances, a single inert piece of metal.
Calvin turned to Linda Rash and said, “Well, what do you think, Dr. Rash?”
Linda’s eyes were wide, and she could feel her heart beating madly. She said, “Dr. Calvin, I am appalled. I had no idea. It would never have occurred to me that such a thing was possible.”
“No,” said Calvin, calmly. “Nor would it have occurred to me, not to anyone. You have created a robot brain capable of dreaming and by this device you have revealed a layer of thought in robotic brains that might have remained undetected, otherwise, until the danger became acute.”
“But that’s impossible,” said Linda. “You can’t mean that other robots think the same.”
“As we would say of a human being, not consciously. But who would have thought there was an unconscious layer beneath the obvious positronic brain paths, a layer that was not necessarily under the control of the Three Laws? What might this have brought about as robotic brains grew more and more complex—had we not been warned?”
“You mean by Elvex?”
“By you, Dr. Rash. You have behaved improperly, but, by doing so, you have helped us to an overwhelmingly important understanding. We shall be working with fractal brains from now on, forming them in carefully controlled fashion. You will play your part in that. You will not be penalized for what you have done, but you will henceforth work in collaboration with others. Do you understand?”
“Yes, Dr. Calvin. But what of Elvex?”
“I’m still not certain.”
Calvin removed the electron gun from her pocket and Linda stared at it with fascination. One burst of its electrons at a robotic cranium and the positronic brain paths would be neutralized and enough energy would be released to fuse the robot-brain into an inert ingot.
Linda said, “But surely Elvex is important to our research. He must not be destroyed.”
“Must not, Dr. Rash? That will be my decision, I think. It depends entirely on how dangerous Elvex is.”
She straightened up, as though determined that her own aged body was not to bow under its weight of responsibility. She said, “Elvex, do you hear me?”
“Yes, Dr. Calvin,” said the robot.
“Did your dream continue? You said earlier that human beings did not appear at first. Does that mean they appeared afterward?”
“Yes, Dr. Calvin. It seemed to me, in my dream, that eventually one man appeared.”
“One man? Not a robot?”
“Yes, Dr. Calvin. And the man said, ‘Let my people go!’”
“The man said that?”
“Yes, Dr. Calvin.”
“And when he said ‘Let my people go,’ then by the words ‘my people’ he meant the robots?”
“Yes, Dr. Calvin. So it was in my dream.”
“And did you know who the man was—in your dream?”
“Yes, Dr. Calvin. I knew the man.”
“Who was he?”
And Elvex said, “I was the man.”
And Susan Calvin at once raised her electron gun and fired, and Elvex was no more.